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PROCESSOR WITH REDUCED MEMORY REQUIREMENTS FOR HIGH-SPEED 



ROUTING AND SWITCHING OF PACKETS 



Field of the Invention 

The present invention relates generally to packet processing systems, and more particularly 
to a network processor or other type of processor configured for use in performing packet routing, 
packet switching and other packet processing operations within such a system. 

Background of the Invention 

A network processor generally controls the flow of packets between a physical transmission 
medium, such as a physical layer portion of, e.g., an asynchronous transfer mode (ATM) network 
or synchronous optical network (SONET), and a switch fabric in a router or other type of packet 
switch. Such routers and switches generally include multiple network processors, e.g., arranged in 
the form of an array of Hne or port cards with one or more of the processors associated with each of 
the cards. 

Li performing packet processing operations such as routing or switching, the network 
processor typically must examine at least a portion of the beginning or head of each packet. The 
amount of each packet that must be examined is dependent upon its associated network 
communication protocols, enabled options, and other similar factors. The sophistication or 
complexity of the router or switch can also influence the amount of each packet that will need 
examination. 

Many conventional routers and switches are configured to store, for a given packet being 
processed, substantially the entire packet, until tiiat packet is finally transmitted to its destination or 
dropped. The packet is usually stored in a router or switch memory extemal to the associated 
network processor. The amoxmt of time the given packet may be kept in extemal memory is 
influenced by the basic processing time of the router or switch, the quality of service apphed to the 
packet, the particular protocol layers to be analyzed, and the congestion of the port or other 
communication channel to which the packet is directed. 

High-speed routers and switches will typically store in on-chip memory within the network 
processor some portion of a given packet being processed by that network processor. This greatly 
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enhances the performance of the router or switch by not requiring it to access the larger external 
memory holding the entire packet, in that the external memory is slower and more band-limited than 
the on-chip memory. However, in conventional practice, the worst-case packet portion that may 
need to be analyzed in a given router or switch appUcation usually dictates the size of every packet 
portion kept in on-chip memory, even though the worst-case packet portion may be associated with 
only certain rarely-occurring packets. This significantly increases the required size of the on-chip 
memory, and thus the cost and complexity of the network processor. 

It is therefore apparent that a need exists for improved techniques for determining particular 
portions of packets to be stored in particular memories associated with a network processor or other 
type of processor, so as to reduce the memory requirements of the device. 

Summary of the Invention 

The invention provides a significant reduction in the memory requirements of a network 
processor or other type of processor. 

In accordance with one aspect of the invention, a processor includes a packet analyzer and 
first memory circuitry operatively coupled to the packet analyzer. The packet analyzer is operative 
to at least partially analyze one or more packets received by the processor in order to determine for 
a given one of the packets a portion of the packet to be stored in the first memory circuitry. The 
portion of the given packet when stored in the first memory circuitry is thereby made accessible for 
subsequent processing within the processor, without requiring access to second memory circuitry 
associated with the processor and configured to store substantially the entire given packet. The first 
and second memory circuitry may comprise, e.g., respective intemal and external memories of the 
processor. 

In accordance with another aspect of the invention, the packet analyzer may be configured 
to utihze a value stored in a register of the processor to determine the portion of the given packet to 
be stored in the first memory circuitry, e.g., in intemal memory. The register may be one of a 
number of registers which implement a look-up table accessible to the packet analyzer. The look-up 
table includes multiple entries, each having packet categorizing information, such as port number 
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or packet flow identifier, and an associated number of blocks of the packet to be stored in the internal 
memory. 

In accordance with a further aspect of the invention, the value stored in a given one of the 
registers may be dynamically updatable, e.g., under control of a host device operatively coupled to 
5 the processor. This allows a programmer to specify, e.g., the particular portions of a given category 
of packets to be stored in the intemal memory of the processor. 

Advantageously, the techniques of the invention not only reduce the processor intemal and/or 
external memory requirements, but substantially reduce the need for accesses to external memory, 
thereby increasing processor throughput. 

W 

O Brief Description of the Drawing s 

j|i FIG. 1 is a simplified block diagram of a packet processing system in which the present 

to invention is implemented. 

flj FIG. 2 is a more detailed view of a network processor of the FIG. 1 system configured in 

15 accordance with the techniques of the invention. 

issais 

Rj FIG. 3 illustrates a look-up table data structure that may be utilized in the network processor 

,fi of FIG. 2 to store packet identifiers and corresponding atnounts of the packets to be stored in an 
intemal memory, in accordance with the invention. 

FIG. 4 is a flow diagram of a packet analysis and storage process that is implementable in 
20 the FIG. 1 system by the FIG. 2 network processor in accordance Avith the invention. 

Detailed Description of the Invention 

The invention will be illustrated herein in conjunction with an exemplary packet processing 
system which includes a network processor configured in a particular mamier. It should be 
25 understood, however, that the invention is more generally applicable to any processor in which it is 
desirable to reduce the intemal and/or external memory requirements associated with packet 
processing operations performed in the processor. 

A "processor" as the term is used herein may be implemented, by way of example and 
without limitation, utilizing a microprocessor, central processing unit (CPU), digital signal processor 
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(DSP), application-specific integrated circuit (ASIC), or other type of data processing device, as well 
as portions and combinations of these and other devices, A given processor suitable for use with the 
present invention may include both an internal memory, e.g., on-chip memory, and an extemal 
memory. The term "processor" is intended to be construed generally so as to encompass such an 
extemal memory. 

The present invention in an illustrative embodiment reduces the amount of memory required 
in a network processor by partially analyzing enough of each packet as it arrives at the network 
processor so as to be able to allocate only the amount of memory needed to store the pertinent 
portion of the packet. At the appropriate time the packet can then be completely analyzed from that 
stored portion. This allows for higher packet throughput in the network processor because of a 
reduced need to access extemal memory. It thus reduces system cost due to a reduction in the 
required bandwidth to extemal memory and the associated impact of simplification in the overall 
processing system design. 

FIG. 1 shows a packet processing system 100 in which the invention is implemented. The 
system 100 includes a network processor 102 having an intemal memory 104. The network 
processor 102 is coupled to an extemal memory 106 as shown, and is configured to provide an 
interface between a network 108 firom which packets are received and a switch fabric 1 10 which 
controls switching of packet data. The processor 102 and its associated extemal memory 106 may 
be implemented, e.g., as one or more integrated circuits installed on a line card of a router or switch. 
In such a configuration, the switch fabric 1 10 is generally considered to be a part of the router or 
switch. 

Although the memory 1 06 is shown in the figure as being extemal to the processor 1 02, the 
term "processor" as used herein, as indicated previously, is intended to be sufficiently broad to 
encompass elements 102 and 106. 

It should be understood that the particular arrangement of system elements shown in FIG. 
1 is by way of illustrative example only. For example, as previously noted, the invention can be 
implemented in any type of packet processor, and is not limited to any particular packet processing 
application. 
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FIG. 2 shows the network processor 102 of FIG. 1 in greater detail. The network processor 
102 in this embodiment includes a packet analyzer 200 which receives incoming packets from the 
network 1 08, The packet analyzer is coupled to a memory controller 202 which in this embodiment 
interfaces with the internal memory 104 and the extemal memory 106. Theprocessor 102 may also 
include or otherwise have associated therewith other processing cncuitry not shown in the figure, 
such as a traffic manager. 

In accordance with the invention, the packet analyzer 200 is operative to at least partially 
analyze one or more packets received by the network processor 1 02 in order to determine for a given 
one of the packets a portion of the packet to be stored in the internal memory 104. The portion of 
the given packet when stored in the intemal memory 104 is thereby accessible for subsequent 
processing within the network processor 102 without requiring access to the extemal memory 106, 
which is typically configured to store substantially the entire given packet. The portion of a given 
packet to be stored in the intemal memory 1 04 may be, e.g., a designated portion of a header of the 
packet. The memory controller 202 is operative to control the storage of the designated portion of 
the given packet in the intemal memory 104, and to control the storage of substantially the entire 
packet in the extemal memory 106. 

The packet analyzer 200 thus at least partially analyzes at least a subset of the packets 
received from the network 108 and determines for each of the analyzed packets a particular portion 
of the packet to be stored in the intemal memory 104. The determination may be based, e.g., on 
identifying a port number, packet flow identifier or other packet characterizing information 
associated with a given packet, and reading a designator of an associated number of blocks from a 
corresponding register or other memory location, as will be described in more detail below. The 
determined portion is generally a portion required for subsequent processing within the network 
processor 102, such that when the determined portion is stored in the intemal memory 102, the 
subsequent processing can be performed without requiring access to the extemal memory for any 
other portion of the packet. 

It should be noted that the techniques of the invention can also be apphed to reducing the 
memory requirements associated with an extemal memory, e.g., by determining a particular portion 
of a packet to be stored in first memory circuitry where substantially the entire packet is stored in 
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second memory circuitry, with either or both of the first and second memory circuitry representing 
external memory. Such first and second memory circuitry may also correspond to the respective 
intemal and extemal memories 1 04, 1 06 of FIG. 1 . The first and second memory circuitry may thus 
represent separate memories, but may alternatively represent different portions of a single intemal 
or extemal memory. 

Although shown as a single memory controller, the memory controller 202 may include 
separate controllers for each of the intemal memory 104 and the extemal memory 106, as will be 
appreciated by those skilled in the art. 

The packet analyzer 200 communicates via the memory controller 202 with a look-up table 
205 implemented using a set of registers in a portion of the intemal memory 104. The look-up table 
205 provides information that is utilized by the packet analyzer 200 to determine the particular 
portion of a given packet to be stored in the intemal memory 104. 

It should be noted that the look-up table 205 may be in a separate memory in another 
embodiment of the invention, rather than implemented as part of the intemal memory 1 04 as shown 
in the figure. 

FIG. 3 A shows one example of a set of registers comprising the look-up table 205. In this 
example, the look-up table 205 includes N different entries, each stored in a corresponding register 
of the intemal memory 104, Each entry includes a port number and a corresponding number of 
blocks. The port number corresponds to one of N ports that may be associated with packets arriving 
at the network processor 102. For example, a given network processor may support 256 ports or 
more. The number of blocks specified for a given port indicates the number of blocks of each packet 
arriving at that port that are to be stored in the intemal memory 104. A block is preferably specified 
as a particular number of bytes. For example, in the illustrative embodiment, a block may be 64 
bytes. It should be noted that a particular predetermined block value, e.g., a block value of zero, 
stored as an entry in the look-up table 205, may indicate that for each packet arriving on the 
corresponding port, substantially the entire packet is to be stored in the intemal memory 104, up to 
a specified maximum value, e.g., 64 kilobytes. 

The packet analyzer 200 in the FIG. 3A example is configured to determine for a given 
packet the particular port number associated with the given packet. The packet analyzer 200 then 
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uses the determined port number as an input to the look-up table 205 to determine the corresponding 
number of blocks of that packet to be stored in the internal memory 1 04. That number of blocks of 
the packet are then stored in the intemal memory 104 under the direction of the memory controller 
202. 

FIG. 3B shows another example of a set of registers comprising the look-up table 205. In 
this example, the look-up table 205 again includes N different entries, each stored in a corresponding 
register of the intemal memory 104. However, in this case, each entry includes a packet identifier 
and a corresponding number of blocks. The packet identifier may comprise, e.g., a packet flow 
identifier which specifies particular related packets, or any other suitable packet identifying 
information. As in the previous example, the number of blocks specified for a given packet 
identifier indicates the number of blocks of each packet having the corresponding packet identifier 
that are to be stored in the intemal memory 104. Again, a block is preferably specified as a 
particular number of bytes, e.g., 64 bytes, and a zero block entry may denote that substantially the 
entire packet is to be stored in the intemal memory 104 up to a specified maximum value. 

The packet analyzer 200 in the FIG. 3B example is configured to determine for a given 
packet the particular packet identifier associated with the given packet. The packet analyzer 200 
then uses the determined packet identifier as an input to the look-up table 205 to determine the 
corresponding number of blocks of that packet to be stored in the intemal memory 104. That 
number of blocks of the packet are then stored in the intemal memory 104 under the direction of the 
memory controller 202. 

It is to be appreciated that the particular examples of FIG. 3 A and 3B are not intended to 
limit the scope of the invention in any way. Those skilled in the art will recognize that numerous 
alternative look-up table configurations are possible. For example, it is possible to use other types 
of packet categorizing techniques, and different approaches to specifying the particular portion to 
be stored in memory for a given packet category. 

FIG. 4 is a flow diagram of a general packet analysis and storage process that is 
implementable in the packet processing system 100 of FIG. 1 by the network processor 102. The 
process is illustrated for a single packet, but similar processing may be applied to each received 
packet. It should also be emphasized that the FIG. 4 process in its entirety should be considered 
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merely exemplary and illustrative of the techniques of the invention, rather than limiting in nature. 
Although not shown in the figure, the FIG. 4 process may include a preliminary step of initializing 
the look-up table entries to desired values. 

In step 400, a packet to be processed is received by the network processor 1 02. The packet 
analyzer 200 in step 402 partially analyzes the packet to determine the portion required for 
subsequent processing within the network processor. As indicated previously, this determination 
may be made by accessing the look-up table 205 to determine a particular number of blocks of the 
packet to be stored in the internal memory. In step 404, the required portion of the packet as 
determined from the look-up table 205 is stored in the internal memory 104. In step 406, the entire 
packet is stored in the extemal memory 106. The storage of the entire packet in external memory 
after storage of the required portion in intemal memory is by way of example only, and not a 
requirement of the invention. For example, the entire packet could be stored in extemal memory 
prior to performing steps 402 and 404 of the process. As another example, only the remaining 
portion of the packet, i.e., the portion other than the portion stored in intemal memory in step 404, 
may be stored in the extemal memory in step 406. Moreover, steps 404 and 406 may be performed 
substantially in parallel. In any case, at packet processing time, i.e., at a time at which the above- 
noted subsequent processing is to be performed on the required portion of the packet, that portion 
of the packet is retrieved from the intemal memory 104 as needed to implement the appropriate 
processing operations in the network processor. 

Each entry of the look-up table 205 may be dynamically updated via appropriate software 
control. For example, a given "number of blocks" value for an entry in the look-up table 205 can 
be initially stored therein or updated under the control of a host processor coupled to the network 
processor 1 02, e.g., via a peripheral component interconnect (PCI) bus. Advantageously, this allows 
a programmer to specify for particular port numbers, packet flow identifiers or other categories of 
packets the particular number of blocks of those packets to be stored in intemal memory. In general, 
such a programmer will typically know the particular protocols associated with a given packet 
category, and thus knows an appropriate portion of each of the packets to be kept in an intemal 
memory for optimal processing throughput. A given stored value in the look-up table 205 can be 
dynamically updated under software control for each packet in a sequence of the received packets. 
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Alternatively, the same value may be utilizable for multiple ones of the received packets, as in the 
examples of FIGS. 3 A and 3B. 

The above-described embodiments of the invention are intended to be illustrative only. For 
example, although the illustrative embodiments utilize a single look-up table with each entry 
including packet categorizing information and an associated number of blocks of the packet to be 
stored in intemal memory, other embodiments can use different types of registers or memory 
arrangements for implementing the described functionality. In addition, although the designated 
portion of a given packet to be stored in intemal memory or other first memory circuitry may 
represent a portion of a header of the packet, it may altematively represent a substantially larger 
portion of the packet, and may be as much as the entire packet for certain predetermined block 
number entries, e.g., a zero entry. These and numerous other altemative embodiments within the 
scope of the following claims will be apparent to those skilled in the art. 



